Action capsules: Human skeleton action recognition

نویسندگان

چکیده

Due to the compact and rich high-level representations offered, skeleton-based human action recognition has recently gained more attraction. Although joint relationships investigation in spatial temporal dimensions provides effective information critical recognition, effectively encoding global dependencies of joints during spatio-temporal feature extraction is a prohibitive task. In this paper, we introduce Action Capsule which identifies action-related key by considering latent correlation skeleton sequence. We show that, inference, our end-to-end network pays attention set specific each action, whose encoded features are aggregated recognize action. Additionally, use multiple stages capsules enhances ability classify similar actions. A comparative analysis capsule-based approach with other widely-used methods given, highlighting advantages proposed handling missing data leveraging iterative processing. Consequently, outperforms state-of-the-art approaches on N-UCLA dataset obtains competitive results NTURGBD dataset. This while significantly lower computational requirements based GFLOPs measurements.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Leveraging the Path Signature for Skeleton-based Human Action Recognition

Human action recognition in videos is one of the most challenging tasks in computer vision. One important issue is how to design discriminative features for representing spatial context and temporal dynamics. Here, we introduce a path signature feature to encode information from intra-frame and inter-frame contexts. A key step towards leveraging this feature is to construct the proper trajector...

متن کامل

Skeleton-Based Human Action Recognition with Profile Hidden Markov Models

Recognizing human actions from image sequences is an active area of research in computer vision. In this paper, a novel HMMbased approach is proposed for human action recognition using 3D positions of body joints. First, actions are segmented into meaningful action units called dynamic instants and intervals by using motion velocities, the direction of motion, and the curvatures of 3D trajector...

متن کامل

Informative joints based human action recognition using skeleton contexts

The launching of Microsoft Kinect with skeleton tracking technique opens up new potentials for skeleton based human action recognition. However, the 3D human skeletons, generated via skeleton tracking from the depth map sequences, are generally very noisy and unreliable. In this paper, we introduce a robust informative joints based human action recognition method. Inspired by the instinct of th...

متن کامل

Human Action Recognition with an Incomplete Real - Time Pose Skeleton

Currently, most human action recognition systems are trained with feature sets that have no missing data. Unfortunately, the use of human pose estimation models to provide more descriptive features also entails an increased sensitivity to occlusions, meaning that incomplete feature information will be unavoidable for realistic scenarios. To address the problem of occlusions, this paper proposes...

متن کامل

Enhanced skeleton visualization for view invariant human action recognition

Human action recognition based on skeletons has wide applications in human–computer interaction and intelligent surveillance. However, view variations and noisy data bring challenges to this task. What’s more, it remains a problem to effectively represent spatio-temporal skeleton sequences. To solve these problems in one goal, this work presents an enhanced skeleton visualization method for vie...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Computer Vision and Image Understanding

سال: 2023

ISSN: ['1090-235X', '1077-3142']

DOI: https://doi.org/10.1016/j.cviu.2023.103722